Coupling Techniques for Nonlinear Ensemble Filtering
نویسندگان
چکیده
We consider filtering in high-dimensional non-Gaussian state-space models with intractable transition kernels, nonlinear and possibly chaotic dynamics, sparse observations space time. propose a novel methodology that harnesses transportation of measures, convex optimization, ideas from probabilistic graphical to yield robust ensemble approximations the distribution high dimensions. Our approach can be understood as natural generalization Kalman filter (EnKF) updates, using stochastic or deterministic couplings. The use updates reduce intrinsic bias EnKF at marginal increase computational cost. avoid any form importance sampling introduce localization approaches for dimension scalability. framework achieves state-of-the-art tracking performance on challenging configurations Lorenz-96 model regime.
منابع مشابه
Adaptive ensemble Kalman filtering of nonlinear systems
A necessary ingredient of an ensemble Kalman filter is covariance inflation [1], used to control filter divergence and compensate for model error. There is an ongoing search for inflation tunings that can be learned adaptively. Early in the development of Kalman filtering, Mehra [2] enabled adaptivity in the context of linear dynamics with white noise model errors by showing how to estimate the...
متن کاملEnsemble Kalman Filtering with Shrinkage Regression Techniques
The classical Ensemble Kalman Filter (EnKF) is known to underestimate the prediction uncertainty resulting from model overfitting and estimation error. This can potentially lead to low forecast precision and an ensemble collapsing into a single realisation. In this paper we present alternative EnKF updating schemes based on shrinkage methods known from multivariate linear regression. These meth...
متن کاملClustering Ensemble for Spam Filtering
One of the main problems that modern e-mail systems face is the management of the high degree of spam or junk mail they recieve. Those systems are expected to be able to distinguish between legitimate mail and spam; in order to present the nal user as much interesting information as possible. This study presents a novel hybrid intelligent system using both unsupervised and supervised learning t...
متن کاملCollaborative Filtering Ensemble for Ranking
This paper provides the solution of the team “commendo” on the Track2 dataset of the KDD Cup 2011 Dror et al.. Yahoo Labs provides a snapshot of their music-rating database as dataset for the competition, consisting of approximately 62 million ratings from 250k users on 300k items. The dataset includes hierachical information about the items. The goal of the competition is to distinguish beteen...
متن کاملCollaborative Filtering Ensemble
This paper provides the solution of the team “commendo” on the Track1 dataset of the KDD Cup 2011 Dror et al.. Yahoo Labs provides a snapshot of their music-rating database as dataset for the competition. We get approximately 260 million ratings from 1 million users on 600k items. Timestamp and taxonomy information are added to the ratings. The goal of the competition was to predict unknown rat...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Siam Review
سال: 2022
ISSN: ['1095-7200', '0036-1445']
DOI: https://doi.org/10.1137/20m1312204